3D Object Detection and Pose Estimation of Unseen Objects in Color Images with Local Surface Embeddings
نویسندگان
چکیده
We present an approach for detecting and estimating the 3D poses of objects in images that requires only untextured CAD model no training phase new objects. Our combines Deep Learning geometry: It relies on embedding local geometry to match models input images. For points at surface objects, this can be computed directly from model; image locations, we learn predict it itself. This establishes correspondences between 2D locations However, many these are ambiguous as may have similar geometries. show use Mask-RCNN a class-agnostic way detect without retraining thus drastically limit number possible correspondences. then robustly estimate pose discriminative using RANSAC-like algorithm. demonstrate performance T-LESS dataset, by small testing other experiments our method is par or better than previous methods.
منابع مشابه
Spatio-temporal 3D Pose Estimation of Objects in Stereo Images
In this contribution we describe a vision system for modelbased 3D detection and spatio-temporal pose estimation of objects in cluttered scenes. As low-level features, our approach requires 3D depth points along with information about their motion and the direction of the local intensity gradient. We extract these features by spacetime stereo based on local image intensity modelling. After appl...
متن کاملJoint Object Category and 3D Pose Estimation from 2D Images
2D object detection is the task of finding (i) what objects are present in an image and (ii) where they are located, while 3D pose estimation is the task of finding the pose of these objects in 3D space. State-of-the-art methods for solving these tasks follow a two-stage approach where a 3D pose estimation system is applied to bounding boxes (with associated category labels) returned by a 2D de...
متن کاملTowards Pose Estimation of 3D Objects in Monocular Images via Keypoint Detection
The availability of a large number of crowdsourced CAD models of objects can be leveraged to solve the problem of pose estimation of 3D objects in monocular images. Convolutional Neural Networks(CNNs) perform to the best of their capability when they have been trained on a large amount of labeled data. We explore how 3D models can be used to generate lots of training images and annotations in t...
متن کاملDeep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimation
We present a 3D object detection method that uses regressed descriptors of locally-sampled RGB-D patches for 6D vote casting. For regression, we employ a convolutional auto-encoder that has been trained on a large collection of random local patches. During testing, scene patch descriptors are matched against a database of synthetic model view patches and cast 6D object votes which are subsequen...
متن کامل3D Object Pose Refinement in Range Images
Estimating the pose of objects from range data is a problem of considerable practical importance for many vision applications. This paper presents an approach for accurate and efficient 3D pose estimation from 2.5D range images. Initialized with an approximate pose estimate, the proposed approach refines it so that it accurately accounts for an acquired range image. This is achieved by using a ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2021
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-030-69525-5_3